Equivalence classes for large deviations 



David Andrieux 

We show the existence of equivalence classes for large deviations. Stochastic dynamics within an 
equivalence class share the same large deviation properties. 



KEY TAKEAWAYS 

• An equivalence relation for stochastic dynamics is defined. Stochastic dynamics that belong to the same equiv- 
^ ■ alence class have the same large deviations. 

• Stochastic dynamics can be factored into an equilibrium and a nonequilibrium part. The equilibrium part is 
common to all elements of an equivalence class. 

• Large deviations can be expressed in terms of a scalar field defined on the equivalence classes. The symmetry 
of this field gives rise to the symmetries of the fluctuations theorems. 

• The large deviations of an equilibrium dynamics determine the large deviations of all the nonequilibrium dy- 
namics within its equivalence class. 



I. FRAMEWORK 
A. Markov chains 

We consider a Markov chain characterized by a transition matrix P = (Pij) G H NxN on a finite state space. The 
operator P is stochastic, i.e., it is non-negative (P > 0) and its rows sum to one (J^j Pij = !)• We assume that the 
Markov chain is primitive, i.e., there exists an uq such that P n ° has all positive entries. This guarantees that P has 
a unique stationary distribution n such that n = wP. 

For further reference, we note that a non-negative matrix can be transformed into a stochastic matrix. Indeed, 
consider a non-negative matrix A and denote its Perron root by x an d its right Perron vector by x. Then if D = 
diag(xi, . . . , xn) we have that 



P=-D~ i AD (1) 



is a stochastic matrix. 



B. Thermodynamic description 

A Markov chain P defines an equilibrium dynamics when 

Pi 1 t 2 ■ ■ ■ Pi„i! = Pi t i n ■ ■ ■ Pi 2 n for any finite sequence «2, •■■,i n ) ■ (2) 

In this case, no probability flux is present at the stationary state. 

When the conditions ([2]) are not satisfied we are in presence of a nonequilibrium dynamics. In this case, probability 
fluxes ciculate through the system and generate thermodynamic forces or affinities. The affinities can be measured 
by the breaking of detailed balance along cyclic paths c = i2, • • ■ , in) as 

P P 

p p — = exp (Ac) . (3) 

*iii n • • • ^i<2i\ 

However, Schnakenberg demonstrated that only a subset of these affinities are independent^ He also showed how 
to identify a basis of affinities A — (A\, . . . , Ai, . . . , Am) based on the concept of fundamental chords. A summary of 
his theory is presented in the Appendix. 
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II. THERMODYNAMIC DECOMPOSITION OF STOCHASTIC DYNAMICS 

Stochastic dynamics can be brought into a "thermodynamic form" through a similarity transform. This form 
decomposes the dynamics into an equilibrium and a nonequilibrium part. It is thus expressed in terms of two 
operators E and Z , defined as 



E %] [P] = ^P~P~ (4) 

and 

J exp (ztfii/2) if the transition i — > j is a fundamental chord I in the positive (negative) orientation, 

z aW = \ , * ( 5 ) 

I 1 otherwise. 

The operator E is symmetric, E — E T , while Z(fi) = Z T (—fi). 
We have the following 

Proposition. A stochastic matrix P with affinities A is similar to 

E[P] o Z(A) , (6) 
where X oY denotes the Hadamard product: (X o Y)- = XijYij. 

DEMONSTRATION: We consider the similarity transform 

P' = upu- 1 

with U = diag(ui, . . . , ujv)- Therefore P- = Pij(ui/uj). We choose the elements Ui such that 



( Pji 



XI <j \ P ij 



(7) 



for all the transitions i f± j that do not correspond to a chord. We have thus constrained the ratios ([7]) along the 
edges of the maximal tree. By construction, this provides a consistent set of equations whose solution is determined 
up to a multiplicative factor. 

The elements of P then take the values 



Pi] — \ I'-jl'}. — [P] Zij 



if the transition i — > j is not a chord. 

The elements corresponding to chords are obtained as follows. Consider the chord I = ii — >■ i\ (in the positive 
orientation) and its fundamental cycle q = («!,••■ We have the identity 



i-i 

J~J u 'fc+l _ u ii J~J U ik + l _ ^ 

k=l Uik Utl k=l Ulk 

where = i\. By construction, a fundamental cycle q only contains its associated chord I. Hence, using formulas 
([3]) and (J7J), we have 



Accordingly, the operator element associated with the chord i reads 

4ix = \/ P ni. P i,ii e A,/2 = E lin [P]Z lltl {A) . 
Similarly, P' hil = ^/P^iJ\i, exp(-A ; /2) = E ilit [-P^m, (A) for the negative orientation. □ 

We call (JSJ the thermodynamic form of P. The operator E captures the equilibrium part of the dynamics while 
Z measures the nonequilibrium conditions. This form is symmetric for equilibrium dynamics, while the symmetry is 
explicitly broken by the affinities out of equilibrium. 

Note that this form preserves the eigenvalues of P as well as its affinities. Also, the same similarity transform U 
brings a non-negative matrix into its thermodynamic form. 
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III. EQUIVALENCE RELATION 

The thermodynamic decomposition (|6|) structures the space of stochastic dynamics into equivalence classes. We 
define the equivalence relation 

P ~ H if there exists a factor 7 such that E[P] = 7 E[H] . (8) 

This relation is reflexive, symmetric, and transitive. It thus forms a partition of the space of stochastic dynamics: 
every dynamics belongs to one and only one equivalence class. 

We can parametrize the elements of an equivalence class. For simplicity, we work in the thermodynamic represen- 
tation © and use the equivalence ([T]) between non-negative and stochastic matrices^ We then have the 

Proposition. The equivalence class [P] is composed of all the dynamics 

E[P] o Z{p) , (9) 
where the parameters fj. can take any values in R M . 

DEMONSTRATION: All elements in [P] can be written in the form ©. This results from Proposition 1 and the 
definition of Z. Conversely, elements of the form © belong to [P]. □ 

Note that an equivalence class covers all possible thermodynamic conditions. Among these, the dynamics E is the 
unique equilibrium dynamics; it also defines the common structure for all elements in the class. 

In the following we show that the equivalence relation © plays a pivotal role in understanding large deviations. 

IV. LARGE DEVIATIONS AND THERMODYNAMIC FORM 

We define a scalar field p over the equivalence class [P] as 

p(P,[i) = spectral radius of E[P] o Z(ji) . (10) 

It has the symmetry property 

p(P,p)=p(P 1 -lt). (11) 

Large deviations can be expressed in terms of the field p. Indeed, the large deviations of P are obtained as (minus 
the logarithm of) the largest eigenvalue of 

PoQ(X), (12) 

where Q(X) is a non-negative operator that measures the physical quantities of interest. Using that E[Q] = I, where 
I is the identity matrix, and that Z(x) o Z(y) = Z(x + y), the thermodynamic form of (fT2"j) reads 

E[P] oZ[A + q(\)] . (13) 

The function q is readily calculated by looking at the transition probabilities of Q along cycles. The large deviations 
are then given by p[P,A + q(X)]. 

Example: Large deviations of the entropy production. In this case the operator Q(X) takes the form 

««M = (|) A . 

In the thermodynamic representation P o Q(X) reads 

E[P] o Z[(l - 2X)A] . 

Therefore, the large deviations of the entropy production probe the dynamics in [P] with affinities (1 — 2X)A. They 
are thus given by p[P, (1 — 2X)A\. Note that the fluctuation symmetry A — >• 1 — A follows from the symmetry pT|) . 
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V. LARGE DEVIATIONS WITHIN AN EQUIVALENCE CLASS 

For concreteness, we consider the large deviations of the thermodynamic currents. They are measured by the 
operator Q(X) = Z(—2\). Therefore, they are obtained from p(P,A — 2A). Note that the fluctuation symmetry 
A > A — A follows from the symmetry . 

We have the 

Theorem. Dynamics within an equivalence class share the same large deviations. 

DEMONSTRATION: Note that p(P,/x) = p{P',n) if P and P' are in the same equivalence class. Therefore, the 
large deviations of P, p(P,A — 2A), are obtained from the large deviations of P' , p(P',A' — 2A'), by the parameter 
transformation A' — > A + (A' - A)/2. □ 

Corollary. The large deviations of the equilibrium dynamics E[P] determine the large deviations of the whole 
equivalence class [P]. 

The equilibrium dynamics E[P] thus presents the same large deviation properties as P. In this sense, E[P] is the 
natural equilibrium state of P from a dynamical viewpoint £ 



Disclaimer. This paper is not intended for journal publication. 



Appendix A: Schnakenberg theory 

Schnakenberg's theory decomposes the thermodynamical properties of stochastic dynamics into independent 
contributions i 

A graph G is associated with a stochastic dynamics as follows: each state i of the system corresponds to a vertex 
while the edges represent the different transitions i ^ j allowed between the states. An orientation is given to each 
edge of the graph G. 

A graph G usually contains cyclic paths. However, not all such paths are independent. They can be expressed 
by a linear combination of a smaller subset of cycles, called the fundamental set, which plays the role of a basis in 
the space of cycles. To identify all the independent cycles of a graph we introduce a maximal tree T(G), which is a 
subgraph of G that satisfies the following properties: 

• T contains all the vertices of G; 

• T is connected; 

• T contains no circuit, i.e., no cyclic sequence of edges. 

In general a given graph G has several maximal trees. 

The edges I of G that do not belong to T are called the chords of T. For a graph with N vertex and E edges, there 
exists M = E — N + 1 chords. If we add to T one of its chords I, the resulting subgraph T + I contains exactly one 
circuit, ci, which is obtained from T + I by removing all the edges that are not part of the circuit. Each chord I thus 
defines a unique cycle q called a fundamental cycle. 

We can formulate many important thermodynamic concepts in terms of cycles. For instance, the affinity of an 
arbitrary cycle c is a linear combination of the affinities of a fundamental set>^ 

A(c) = J2^)A( Cl ), 
i 
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where the sum extends over all the chords, and e;(c) = ±1 if c contains the chord / in the positive (+) or negative 
orientation (— ), and otherwise. This illustrates that the fundamental cycles constitute a basis identifying the 
independent contributions to the stochastic process. 



1 J. Schnakenberg, Rev. Mod. Phys, 48, 571 (1976). 

2 A non-negative matrix A and its associated stochastic operator {1} have the same thermodynamic form, up to a multiplicative 
factor. 

3 It does not, however, necessarily coincide with the intuitive equilibrium of the system. For example, consider a three-states 
dynamics P a , with Pi 2 = P13 = P21 = P23 = 1/2, P31 = a. Pi2 = 1 — a. Its thermodynamic equilibrium, from a parametric 
viewpoint, occurs when a = 1/2. However, P[P a ] is not similar to P1/2 when a 7^ 1/2. 

4 Accordingly, the maximal tree T can be chosen arbitrarily because each cycle C; can be redefined by linear combinations of 
the fundamental cycles. 



